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Image pick-up device 
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An image pick-up device comprises a central 


a target mark used as the photography criterion on a 



processing unit which obtains photography advisability 
information showing whether or not an image can be 
picked-up, and an image preprocessor which displays 



display. The image preprocessor changes a form of the 
target mark based on the content of the photography 
advisability information. 
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Description 

FIELD OF THE INVENTION 

[0001 ] The present invention relates to an image pick- 
up device. 

BACKGROUND OF THE INVENTION 

[0002] Recently, image pick-up devices such as dig- 
ital cameras, video cameras, information terminals with 
a photography function, or the like are widely used. The 
image pick-up device picks-up an image of an object us- 
ing a solid image pick-up element such as a CCD 
(charge coupled device). The CCD obtains image data 
of a still image or a movie image of the object so that 
the data are recordedin an IC (integrated circuit) card, 
a disc medium, or the like digitally As the IC card to be 
used, various types are used. That is, IC memory cards 
using a flash memory called a small card, or the like, 
such as a smart medium, a compact flash (CF card), a 
memory stick, a multimedia card (MMC), an SD card, or 
the like are used commonly. 

[0003] The image pick-up devices available in the 
market have a display device such as a liquid crystal 
device (LCD). This display device displays the photo- 
graphed image. The display device can often be used 
as an electron view finder which determines the framing, 
the angle, or the like of the photography field of view, 
that is, an electron finger similar to an optional view find- 
er, that, is a so-called finder by displaying the image 
picked-up by the image pick-up element on the display 
device before photographing. There are also known im- 
age pick-up devices which display information to be the 
criterion to decide whether or not the image is to be 
picked-up. Such a display facilitates the image picking- 
up. 

[0004] For example, Japanese Patent Application 
Laid-Open No. 2000-47315 discloses a technique of 
displaying the distance as the distance measurement 
range or the distance measurement result in a liquid 
crystal display. However, in the configuration of display- 
ing the distance as the distance measurement result, or 
the like, on the liquid crystal display although the dis- 
tance measurement result can be recognized further 
specifically, since the display can be complicated or the 
displayed numerals of the distance measurement 
range, or the like is superimposed on the principal object 
so as to be hardly observed, a problem of interference 
of photography can be involved. 
[0005] As the elements which determine the photog- 
raphy result in the photography, there are mainly, the 
brightness, the focus, the blurring degree, the composi- 
tion, the angle, the flaming, or the like. According to re- 
cent development of the auto exposure (AE) controlling 
technique and the stroboscope controlling technique, as 
to the brightness, the brightness as intended by the pho- 
tographer can easily be obtained. Moreover, according 



to development of the auto focusing (AF) technique, al- 
so as to the focusing, little risk of photography failure is 
involved. 

[0006] Conventionally, there is a camera which focus- 

5 es by combining two or more kinds of auto focusing 
methods for improving the focusing ratio in the auto fo- 
cusing system. The focusing function of combining two 
or more kinds of the auto focusing methods is called the 
hybrid auto focusing function. 

10 [0007] In general, as the auto focusing system, there 
are two types in terms of the focusing operation. The 
first type is for obtaining an appropriate focusing state 
by measuring the object distance and determining the 
projection amount of the photography lens in relation to 

15 the distance measuring operation or according to the 
distance measuring result. The second type is for ob- 
taining an appropriate focusing state by changing the 
projection amount of the photography lens while analyz- 
ing and judging the focusing state and the deviation from 

20 the focal point from the image information obtained via 
the photography lens, such as the contrast information. 
[0008] Since the appropriate focusing state is to be 
obtained finally both in the instance of the first type of 
obtaining the focusing state indirectly by the direct dis- 

25 tance measurement and the instance of the second type 
of obtaining the focusing state by indirectly measuring 
the distance by the direct detection of the focusing state, 
the both focusing operations are referred to as "focus- 
ing" herein. 

30 [0009] According to the hybrid auto focusing function, 
the detection subject areas, such as the distance meas- 
urement area, the focusing detection area, or the like, 
of each of the combined auto focusing systems may dif- 
fer depending on the auto focusing systems. According 

35 to the hybrid auto focusing function, by combining the 
focusing result of a plurality of auto focusing systems, 
the focusing result of any one auto focusing system in 
the plurality of the auto focusing systems, or the synthe- 
sized result of the plurality of the auto focusing systems 

40 is used as the focusing results of the hybrid auto focus- 
ing function. In this instance, there is a risk of having a 
focusing operation with respect to another object in the 
photography field of view instead of a focusing operation 
with respect to an object intended by the user. 

45 [0010] Conventionally, the detection subject area of 
the auto focusing system, that is, a frame showing the 
focusing area, or the like is shown the finder field of view 
in an electron finder or an optical finder. 
[0011] However, according to a camera mounting a 

so conventional hybrid auto focusingf unction, since the de- 
tection subject area of each auto focusing system com- 
prising the hybrid auto focus or a combination thereof, 
that is, the focusing area or the focusing judgment result 
is not displayed, a problem is involved in that the user 

55 cannot see the detection subject area by the hybrid auto 
focusing, the focusing result, or the like specifically. 
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SUMMARY OF THE INVENTION 

[0012] It is an object of the present invention to pro- 
vide an Image pick-up device capable of easily display- 
ing image picking-up advisability information ("photog- 
raphy advisability information") showing advisability of 
the image picking-up ("photography") in an easily un- 
derstandable form without preventing the photography 
operation. 

[0013] It is another object of the present invention to 
provide an image pick-up, device having a hybrid auto 
focusing function as a combination of a plurality of auto 
focusing methods, wherein the detection subject area 
and the focusing judgment result can be provided in de- 
tail specifically to the user. 

[0014] According to the first aspect of the invention, a 
target mark is displayed in a monitor display section or 
a finder display section and a form of the target mark is 
changed according to the content of the photography 
advisability information. 

[0015] According to the second aspect of the inven- 
tion, a detection subject area and the focusing judgment 
result by the auto focusing function as a combination of 
a plurality of auto focusing methods are displayed. 
[0016] - Other objects and features of this invention will 
become apparentf rom the following description with ref- 
erence.to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0017] 

Fig. 1 is a block diagram which shows the configu- 
ration of a principal part of a digital camera accord- 
ing to an embodiment of the present invention, 
Fig. 2A and Fig. 2B are diagrams which explain the 
target mark and the "display form change", 
Fig. 3 is a flow chart which explains the displaying 
operation of the target mark TM, 
Fig. 4A to Fig. 4C are diagrams which explain the 
target mark display method in the instance of a mul- 
tiple point distance measurement auto focusing, 
Fig. 5 is a schematic diagram which shows a display 
example of the auto focusing detection subject area 
represented by the LCD, 

Fig. 6 is a schematic diagram which shows a display 
example of the auto focusing detection subject area 
represented by the LCD, 

Fig. 7 is a schematic diagram which shows a display 
example of the auto focusing detection subject area 
represented by the LCD, 

Fig. 8 is a schematic diagram which shows a display 
example of the auto focusing detection subject area 
represented by the LCD, 

Fig. 9 is a flow chart which explains the focusing 
operation of the hybrid focusing function, and 
Fig. 10 is a diagram which shows the display state 
of a monitoring screen represented by the LCD. 



DETAILED DESCRIPTIONS 

[0018] Embodiments of the image pick-up device of 
the present invention will be explained in detail below 

5 with reference to the accompanied drawings. 

[0019] A digital camera according to a first embodi- 
ment will be explained with reference to Fig. 1 to 4. Fig. 
1 is a block diagram which shows the configuration of 
the principal part of the digital camera according to the 

10 present invention. The digital camera shown in Fig. 1 
comprises a CPU (central processing unit) 1, a photog- 
raphy lens system 2, a CCD image pick-up element 3, 
an A/D (analog-digital) converter 4, an image preproc- 
essor (IPP) 5, a D/A (digital-analog) converter 6, a liquid 

is crystal display device (LCD) 7, a lens driving system 8, 
an AF sensor 9, an internal memory device 1 0, a mem- 
ory controller 11 and an external memory device 12. 
[0020] The CPU 1 is in charge of the mechanical driv- 
ing control, the electronic driving control, and the data 

20 processing concerning various operations in the digital 
camera according to control programs stored in an not- 
shown ROM in response to the operation command 
from an operation section 13. Specifically, it controls the 
auto focusing, the AWB, the automatic exposure, the 

25 photography operation, or the like. 

[0021] The photography lens system 2 is an optical 
system which forms an object image on the input sur- 
face of the CCD image pick-up element 3 as the solid 
image pick-up element. The CCD image pick-up ele- 

30 ment 3 converts the optical image of the object image 
formed on the input surface into an electric signal. The 
A/D converter 4 converts an object image signal as an 
analog signal outputted from the CCD image pick-up el- 
ement 3 into object image data as a digital signal. The 

35 I P P 5 applied a predetermined image process to the ob- 
ject image data controlled by the CPU 1 and digitized 
by the A/D converter 4 as well as it applied a predeter- 
mined image process to the image data provided by the 
CPU 1 as needed. Moreover, the IPP 5 supplies the 

40 processed image data to the CPU 1 as well as to the D/ 
A converter 6 as needed. The D/A converter 6 converts 
the image data as the digital signal supplied from the 
IPP 5 into an analog image signal for display and it sup- 
plies the same to the liquid crystal display device 7. 

45 [0022] The lens driving system 8 is controlled by the 
CPU 1 so as to drive the photography lens system 2 in 
the optical axis direction for the focusing adjustment. 
Moreover, it is also possible to displace the photography 
lens system 2 by manually operating the lens driving 

so system 8. 

[0023] The AF sensor 9 is a sensor which obtains the 
distance measurement information by measuring the 
object distance by the passive auto focusing method or 
the active auto focusing method. It comprises a phase 

55 difference type sensor, an infrared ray type sensor, or 
the like. The distance measurement information of the 
AF sensor 9 is supplied to the CPU 1 . The CPU 1 con- 
trols the AF sensor 9 which measures the distance with 
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respect to the photography object, and controls the lens 
driving system 8 according to the distance measure- 
ment result for displacing the photography lens system 
2 which executes the auto focusing control with respect 
to the photography object. 

[0024] The internal memory device 10 comprises a 
semiconductor memory, or the like, including a RAM 
(random access memory), a ROM (read only memory), 
or the like subordinate to the CPU 1 . It stores the image 
data sent from the IPP 5 to the CPU 1 , the image data 
processed by the CPU 1 , the processing process data 
including the intermediate data concerning the CPU 1 
operation and the controiling process, or the like. 
[0025] The external memory device 12 is a memory 
device which stores the photographed and taken image 
data. In general, a memory medium using a flash mem- 
ory, or the like, and a memory device such as a hard 
disc, can be used. As the memory medium using a flash 
memory, or the like, the so-called SD card, the smart 
medium, the compact flash, the multimedia card, the 
memory stick, or the like, are known. 
[0026] The memory controller 1 1 is an interface which 
controls the writing operation from the CPU 1 to the ex- 
ternal memory device 1 2 and the reading operation from 
the external memory device 1 2 by the CPU 1 , or the like. 
The operation section 13 comprises various buttons 
which commands the digital camera operation by the us- 
er, such as a release button, a mode selection button 
which selects the mode, or the like. 
[0027] At the time of the photography, the above-men- 
tioned CPU 1 has the object image provided via the pho- 
tography lens system 2, the CCD image pick-up element 
3, the A/D converter 4 and the IPP 5 displayed by the 
LCD 7 via the D/A converter 6. Although it is not clearly 
shown, the operation of the CCD image pick-up element 
3, the A/D converter 4, the D/A converter 6 and the LCD 
7 is controlled also by the CPU 1 . 
[0028] Moreover, the CPU 1 executes the focusing 
operation ordinarily by a predetermined cycle. That is, 
a release button (not shown) is provided as a two stage 
step operation release button such that in the first stage 
operation of the release button of the so-called half 
pressed state, the focusing control is newly executed as 
well as the focusing result is maintained during the re- 
lease button first stage operation, that is, as long as the 
half pressed state is continued. In the instance the re- 
lease button is released in this state, the CPU 1 is re- 
turned to the focusing operation control of the predeter- 
mined cycle. Moreover, in the instance the release but- 
ton is further pressed from the release button first stage 
operation of the half pressed state so as to have the 
release button in the second stage, that is, the totally 
pressed state, the CPU 1 stores the image data in the 
internal memory device 10, displays the image confir- 
mation screen on the liquid crystal display device 7, or 
the like, and executes the take-in transfer to the external 
memory device 12. 

[0029] The CPU 1 serves as a photography advisa- 



bility information obtaining unit, and the CPU 1 and the 
IPP 5 serve as a display controlling unit. 
[0030] Next, with reference to Figs. 2A, 2B, 3, 4A to 
4C, the display control for the target mark TM displayed 
5 on the LCD 7 of the digital camera of Fig. 1 will be ex- 
plained. Fig. 2 is a diagram which explains the target 
mark and the "display form change", and Fig. 3 is a flow 
chart which explains the display control for the target 
mark. 

10 [0031] Fig. 2A shows a target mark to be displayed 
on the LCD 7 as the monitor display section. The target 
markTM has a "cross-like shape with vertical and lateral 
straight lines combined like a cross, with the intersection 
part of the lines omitted". For the standby display, it is 

15 shown in "white color. The LCD 7 is for the color image 
display, capable of displaying a desired color. 
[0032] The target mark TM is produced by the CPU 1 
and it is synthesized with an image by a RAW signal 
processed by the YUV conversion by the IPP 7. 

20 [0033] The photographer understands the tilt in the 
horizontal and vertical directions with reference to the 
vertical and lateral lines of the target markTM displayed 
in the LCD 7 so as to execute the auto focusing control 
with the composition determined. According to the auto 

25 focusing operation, the photography lens system 2 is 
displaced and an image (RAW data) taken from the 
CCD3 is displayed on the LCD 7 as mentioned above. 
[0034] According to the auto focusing operation, the 
focus/non-focus thereof is displayed as the "target mark 

30 TM display form" shown in Fig. 2B. 

[0035] That is, when the focus state is not realized af- 
ter starting the auto focusing control operation, the "tar- 
get markTM is displayed in red color" as the non-focus 
(that is, photography unadvisable) state. When the fo- 

35 cus state is realized after executing the auto focusing 
control, the "target markTM is displayed in green color" 
as the photography advisable state. Accordingly, by 
changing the target mark TM display forms (display 
colors), the photographer can know the auto focusing 

40 control result immediately. 

[0036] In the instance the target markTM is displayed 
in green color, since the photography can be executed, 
the photographer executes the photography. At the 
time, the photographed image information has the im- 

45 age process by the I PP 7 so as to be stored in the inter- 
nal memory device 19 via the CPU 1 . Or it is also pos- 
sible to store the same in the external memory device 
23 via a memory controller 21 . 

[0037] Although the instance of executing the auto fo- 
50 cusing control using the distance measurement result 
of the AF sensor 9 has been explained in the above- 
mentioned description, the "contrast detection type" au- 
to focusing control of using the CCD 3 as the AF sensor 
instead of the AF sensor 9, detecting the contrast of the 
55 image inputted to the CCD 3 while driving the photog- 
raphy lens system 2 by a predetermined amount, and 
disposing the photography lens system 2 at a part with 
the highest contrast, can be executed. Also in this in- 
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stance, as mentioned above, the focus/non-focus state 
can be advised to the photographer easily and certainly 
by changing the target mark display form (color). 
[0038] Moreover, to change the display form, in addi- 
tion to the method of changing the color, it is also pos- 
sible to flicker the target mark TM and change the flick- 
ering cycle. For example, the flickering cycle can be 
made shorter in the non-focus state, and the flickering 
can be provided in a "slower cycle" when the focus is 
realized. 

[0039] Furthermore, although the instance of display- 
ing the focus/non-focus state in the auto focusing control 
has been explained, in the instance the AF sensor 9 has 
a distance measuring function, since the distance with 
respect to the photography object and the photography 
lens system 2 displacement amount can be related, the 
focus/non-focus state can be displayed by the target 
mark display form (color, flickering cycle, orthe like) also 
in the instance of executing the manual focusing oper- 
ation. 

[0040] The target mark TM display operation in the 
above-mentioned digital camera will be explained with 
reference to the flow chart of Fig. 3. 
[0041 ] In Fig. 3, at the time of the start, it is in the state 
that the photographer prepares the digital camera. At 
the time, as shown in Fig. 2A, the target markTM is dis- 
played in "white color" to show the standby state. The 
photographer determines the composition according to 
the displayed white color target markTM and half -press- 
es the release button which starts the auto focusing con- 
trol. 

[0042] In Fig. 3, first, in the instance the release button 
is half-pressed by the photographer, the CPU 1 exe- 
cutes the auto focusing control by the AF distance 
measurement, that is, by measuring the distance with 
respect to the object (step S1). Thereafter, the CPU 1 
judges whether or not it is focused (in the figure "AF fo- 
cus") as a result of the auto focusing control (step S2). 
In the instance it is focused as the result of the judgment, 
it moves on to the step S3. In contrast, it is not focused, 
that is, it is non-focused, the CPU 1 controls the IPP 5 
so as to change the target mark TM display color from 
the standby display "white color to "red color as shown 
in Fig. 3 (step S8). While the target mark TM is in red, it 
represents the "photography unadvisable state", 
[0043] At the step S3, when the focus state is realized 
in the auto focusing control, the CPU 1 judges whether 
or not the photography distance at the time (it is known 
as the "distance measurement result") is in a range of 
having the stroboscope effectively workable (in the fig- 
ure "within the distance measurement result strobo- 
scope range"). According to the judgment result, in the 
instance the photography distance is a distance out of 
effective reach of the stroboscope light (in the figure 
"judgment result out of stroboscope reach range NG"), 
since the stroboscope cannot be used as to the "stro- 
boscope use advisability information" as the photogra- 
phy advisability information, the CPU 1 changes the tar- 



get mark TM display color to "purple color (step S5). 
The target mark TM "purple color denotes that the stro- 
boscope light cannot reach the photography object ef- 
fectively. By observing the display, the photographer 

5 can stop the use of the stroboscope. That is, photogra- 
phy of an image with an insufficient light amount by the 
wasteful stroboscope light emission, or consumption of 
the battery can be prevented. In this instance, the pho- 
tographer can change the composition so as to have the 

10 "stroboscope use advisable". 

[0044] In contrast, at the step S3, in the instance the 
distance measurement result is "within the distance 
measurement result stroboscope range", the CPU 1 fur- 
ther judges whether or not the "close distance with the 

15 excessive stroboscope light", that is, "whether the so- 
called "white skip" of the object is not generated in the 
instance the light is emitted from the stroboscope" 
("stroboscope close distance OK" in the figure) (step 
S4). 

20 [0045] As a result of the judgment, in the instance the 
"judgment result stroboscope close distance NG", the 
target mark TM color is changed to "yellow color (step 
S6). The target mark TM "yellow color denotes that it 
is such a close distance that the stroboscope light is ex- 

25 cessive. In this instance, the photographer can change 
the composition so as to have the "stroboscope use ad- 
visability"- Thereby, the "photography without genera- 
tion of a white skip image by the stroboscope" can be 
enabled. 

30 [0046] In contrast, at the step S4, in the instance the 
judgment result is the "stroboscope close distance OK", 
since the stroboscope can be used as well as it is in the 
focused state, the CPU 1 changes the target mark TM' 
color to "green color (step S10). The target mark TM 

35 "green color denotes that the stroboscope can be used* 
and it is in the focused state. Therefore, in the instance" 
of photography using the stroboscope, appropriate pho- 
tography can be executed when the target mark TM is 
in the "green color. 

40 [0047] In the instance the use of the stroboscope is 
not selected, the focus state is displayed by the green 
color target mark, and the non-focus state is displayed 
by the red color target mark. 

[0048] The target mark TM display colors are not lim- 
45 jtedto the above-mentioned "green, red, yellow and pur- 
ple", but a combination of other colors can be used as 
well. 

[0049] Moreover, instead of having the target mark 
TM display form as the "different colors", naturally, the 

so above-mentioned "photography advisability informa- 
tion" displays can be provided by the target mark TM 
flickering cycles. Furthermore, different target mark TM 
display forms can be provided by combining the display 
cdlors and the flickering cycles as well. 

55 [0050] Of course, not only in the auto focusing control, 
but also in the manual focusing mode, according to the 
distance measurement, the photography advisability in- 
formation display can be provided as the target mark 
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display coloring or the flickering cycles. 
[0051] As heretofore explained, according to the first 
embodiment, since the target mark TM to be used as 
the criterion for the photography is displayed, superim- 
posed on the monitoring image displayed on the LCD 7, 
and the target mark TM display form is changed accord- 
ing to the content of the photography advisability infor- 
mation for displaying whether the photography can be 
executed or not, the advisability of the photography can 
be displayed by changing the target mark display forms 
without the need of displaying the distance measure- 
ment range based on the distance measurement result, 
or the like so that the photography advisability informa- 
tion showing the advisability of the photography can be 
displayed simply in an easily understandable form with- 
out preventing the photography. Thereby, the photogra- 
pher can execute the photography operation appropri- 
ately while observing the image to be photographed in 
a good state. 

[0052] Moreover, since the focus/non-focus state in 
the auto focusing control is displayed as the target mark 
display forms using the focus result information (focus/ 
non-focus) in the auto focusing control as the above- 
mentioned photography advisability information, the 
photographer can easily recognize whether the object 
is in the focused state (photography advisable) or not 
(photography unadvisable) in the auto focusing control 
so that the so-called "out of focus" photography can ef- 
fectively be prevented. 

[0053] Furthermore, since the stroboscope use advis- 
ability information is displayed as the target mark display 
forms using the stroboscope use advisability informa- 
tion based on the distance measurement information 
(inside or outside the stroboscope reach limit distance 
range information, inside or outside the stroboscope 
shortest distance range information) as the above-men- 
tioned photography advisability information, the photog- 
rapher can recognize that the stroboscope light cannot 
effectively reach the photography object so that the 
wasteful stroboscope light emission can be prevented. 
[0054] Moreover, since the focus/n on -focus state can 
be displayed as the target mark display form by using 
the focus/non-focus information by the distance meas- 
urement information at the time of the manual focusing 
as the above-mentioned photography advisability Infor- 
mation, and executing the focus judgment by comparing 
the object distance by the manual focusing operation 
with the distance measurement information, the photog- 
raphy can be executed in an appropriately focused state 
also at the time of the manual focusing. 
[0055] Furthermore, since the target mark TM is pro- 
vided in a cross-like shape, observation of the object 
image or the finder image can hardly be prevented. 
Moreover, it can be the criterion in the vertical direction, 
facilitates determination of the photography image com- 
position, and further it is useful forthe check of the image 
tilting (horizontal/vertical). As the target mark, a known 
target mark can be used as well. For example, those 



with a rectangular shape or a parenthesis shape can be 
used. 

[0056] The target mark display example in the in- 
stance the digital camera comprises a multiple point dis- 

5 tance measuring auto focusing function (the case the 
AF sensor 9 can measure the multiple point distances) 
will be explained with reference to Figs. 4A to 4C. Figs. 
4A to 4C are diagrams which explain the target mark 
display example in the instance the multiple point dis- 

10 tance measuring auto focusing function is provided. Fig. 
4A shows a target mark display example in the standby 
state, and Fig. 4B and 4C show target mark display ex- 
amples after focusing. 

[0057] As shown in Fig. 4A, in the standby state, the 
is distance measurement point width (distance measure- 
ment area width) is shown by the cross-like shaped tar- 
get mark TM lateral line length (vertical line length can 
be used as well). Then, as shown in Figs. 4B and 4C, 
the object focusing position is shown by crossing the 
20 vertical line and the lateral line of the cross-like shaped 
target mark. Thereby, also in the instance of the multiple 
point distance measuring auto focusing, the distance 
measurement area can easily be observed as well as 
the focusing position can easily be recognized. Also in 
25 this instance, as mentioned above, the target mark TM 
display color is changed according to the photography 
advisability information. 

[0058] Although the target markTM is displayed in the 
LCD 7 as the monitor display section in the above-men- 

30 tioned first embodiment, the target mark TM can be dis- 
played in an optical type finder display section. 
[0059] A digital camera according to a second embod- 
iment will be explained with reference to Figs. 5 to 10. 
The hardware configuration of the digital camera ac- 

35 cording to the second embodiment is same as that of 
the first embodiment. 

[0060] The digital camera of the second embodiment 
comprises a hybrid auto focusing function. The above- 
mentioned CPU 1 has a function which detects the focus 

40 state based on the object image data supplied from the 
IPP 5, for example, by the contrast analysis, or the like. 
[0061] Moreover, at the time of the photography, the 
CPU 1 has the object image provided via the photogra- 
phy lens system 2, the CCD image pick-up element 3, 

45 the A/D converter 4 and the IPP 5 displayed on the liquid 
crystal display device 7 via the D/A converter 6. Al- 
though it is not clearly shown, the operation of the CCD 
image pick-up element 3, the A/D converter 4, the D/A 
converter 6 and the LCD 7 is controlled also by the CPU 

so 1. Furthermore, the CPU 1 realizes the hybrid auto fo- 
cusing function by the auto focusing method by the dis- 
tance measurement information from the AF sensor 9 
using for example a phase difference type sensor and 
the auto focusing method by the contrast analysis of the 

55 image information provided by the IPP 5, or the like so 
as to execute focusing by controlling the lens driving 
system 8 on occasion based on the combination thereof. 
In this instance, as the hybrid auto focusing function, the 
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" two kinds of the auto focusing methods, that is, the 
phase difference type auto focusing method by the AF 
sensor 9 and the contrast detection type auto focusing 
method by the contrast analysis are combined so as to 
execute the focusing operation by combining the focus- 
ing results thereof. 

[0062] Moreover, by operating the operation section 
13, the user can select as the criterion for the judgment 
of succeeding in focusing by the hybrid focusing function 
any of the (a) method of judging that it is focused finally 
in the instance both of the phase difference type auto 
focusing method and the contrast detection type auto 
focusing methods succeeded in focusing, the (b) meth- 
od of judging that it is focused finally in the instance at 
least one of the phase difference type auto focusing 
method and the contrast detection type auto focusing 
method succeeded the focusing, the (c) method of judg- 
ing that it is focused finally in the instance either of the 
phase difference type auto focusing method and the 
contrast detection type auto focusing method is selected 
automatically based on the brightness in the detection 
subject area or the vicinity thereof, and the selected auto 
focusing method succeeded in focusing, and the (d) 
method of judging that it is focused finally in the instance 
the auto focusing method preliminarily selected by the 
operation of the operation section 1 3 by the user from 
the phase difference type auto focusing method and the 
contrast detection type auto focusing method succeed- 
ed in focusing. The CPU 1 judges the focusing of the 
hybrid focusing function according to the criterion se- 
lected by the operation section 13. 
[0063] Furthermore, by operating the operation sec- 
tion 13, the user can select as the method of displaying 
the detection subject area, the (a) method of identifying 
and displaying the detection subject areas of the phase 
difference type auto focusing method and the contrast 
detection type auto focusing method (see Figs. 5 and 
6), and the (a) method of displaying the detection sub- 
ject area provided by synthesizing the phase difference 
type auto focusing method and the contrast detection 
type auto focusing method (see Figs. 7 and 8). 
[0064] In the above-mentioned configuration, the 
CPU 1 and the IPP 5 serve as an area displaying unit, 
the CPU 1 serves as a judging unit, the CPU 1 and the 
I PP 5 serve as a display changing unit, and furthermore, 
the operation section 13 serves as a selection unit. 
[0065] Next, the operation of the digital camera ac- 
cording to the second embodiment at the time of the AF 
will be explained. As mentioned above, the.'AF sensor 
9 is a phase difference type sensor, an infrared ray type 
sensor, or the like. In contrast, as to the contrast detec- 
tion type auto focusing, the contrast detection is execut- 
ed by the contrast analysis based on the image data 
photographed by the CCD image pick-up element 3. 
[0066] In the instance of the phase difference sensor 
or infrared ray sensor type auto focusing method, the 
distance measurement for the object is executed by the 
AF sensor 9 so that the photography lens system 2 is 



driven by the lens driving system 8 according to the dis- 
tance measurement result. In the instance of the con- 
trast detection type auto focusing method, the contrast 
of the image inputted by the CCD image pick-up element 

5 3 is analyzed while moving the photography lens system 
2 so as to search the position with the highest contrast. 
[0067] Furthermore, the image information (raw data 
signal) taken in from the CCD image pick-up element 3 
is digitized by the A/D converter 4, YUV-converted by 

io the IPP 5, and inputted to the LCD 7 via the D/A con- 
verter 6. The monitoring screen (monitoring image) of 
the object area is displayed on the LCD 7. The auto fo- 
cusing detection subject area is displayed while super- 
imposed on the monitoring screen of the object area in 

15 the LCD 7 by the IPP 5 by the control of the CPU 1 . 
[0068] Figs. 5 and 6 are diagrams that schematically 
show a display example of the detection subject area of 
the auto focusing displayed on the LCD 7. Fig. 5 shows 
a display example before execution of the auto focusing 

20 function, and Fig. 6 shows a display example after exe- 
cuting of the auto focusing function. In Figs. 5 and 6, the 
monitoring screen is not shown. 

[0069] In Fig. 5, the detection subject areas of the two 
kinds of the auto focusing methods (detection subject 

25 area S1 of the contrast detection auto focusing method, 
and the detection subject points B1 , B2, B3 of the three 
point distance measurement auto focusing method us- 
ing a phase difference sensor) are superimposed and 
displayed in different colors in the monitoring screen 

30 (photography field of view image) displayed on the LCD 
7 screen. Here, the detection subject area denotes an 
area having a certain width, and the detection subject 
point denotes a spot-like position as an area having a 
substantially minimum width. 

35 [0070] Specifically, blue color bracket-like area marks k 
"D" showing three mark points B1 , B2, B3 represent the ; 
detection subject points in the three point distance 
measurement auto focusing method using a phase dif- 
ference sensor. Moreover, the range shown by a light 

40 blue color rectangular frame-like area mark S1 repre- 
sents the detection subject area in the contrast detection 
auto focusing method based on the contrast analysis by 
the CPU 1. 

[0071] In the instance the user half-presses the re- 
45 lease button during the monitoring operation (first 
stage), the digital camera executes the focusing opera- 
tion. In the instance focusing by the auto focusing meth- 
od by the AF sensor 9 comprising the phase difference 
sensor is failed and focusing by the contrast detection 
50 type auto focusing method by the CPU 1 is successful 
as a result of the focusing operation, for example, as 
shown in Fig. 6, the disp I ay col or of the detection subject 
points B1 , B2 and B3 is changed from "blue" to "red", 
and the display color of the detectioh subject area S1 is 
55 changed from "light blue" to "green". 

[0072] In general, according to the contrast detection 
type auto focusing method, compared with the auto fo- 
cusing method by the phase difference type sensor, an 
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object at a relatively close distance can be focused as 
well. For example, in the instance of photographing an 
object at a 15cm object distance, in the instance the con- 
trast detection type auto focusing method succeeds in 
focusing even if the auto focusing method by the phase 
difference sensor is non-focused, it is said that the ob- 
ject can be focused. Therefore, oppositely, in the in- 
stance the contrast detection method is failed and the 
phase difference sensor method is successful as the fo- 
cusing result of the auto focusing, there is a risk of non- 
focusing. 

[0073] In contrast, in the instance an object to be fo- 
cused is displaced leftward with respect to the center of 
the photography field of view, for example, in the in- 
stance only the area B1 at the left end is focused among 
the three distance measurement points of the phase dif- 
ference type auto focusing and the other auto focusing 
including the contrast detection type shows non-focus- 
ing, it is assumed that the leftside object is focused. The 
focus or non-focus judgment can be determined by the 
user by observing the focusing judgment result of the 
two auto focusing methods. 

[0074] Moreover, it is also possible that the auto fo- 
cusing detection subject areas are displayed by the 
above-mentioned methods, and the auto focusing judg- 
ment results are changed to have the display color of all 
the display marks B1 to B3 and S1 in "green color 1 ' in 
the instance the focus judgment is provided in the both 
auto focusing methods, and in the other instances, the 
display color of the display marks B1 to B3 and S1 , or 
the like in "red color". It is also possible to define that 
the instance of executing focusing (distance measure- 
ment or focusing operation) by the two auto focusing 
methods and both of them are successful in focusing is 
referred to as being focused in the hybrid auto focusing 
function. 

[0075] According to the above-mentioned display 
method, a user having deep knowledge of the camera 
can judge whether or not actually the camera is appro- 
priately focused on the object depending on the situa- 
tion. However, in the instance of a novice user not hav- 
ing deep knowledge of the camera, the display is rather 
complicated so that it is difficult to judge whether or not 
the object is focused as intended. Hereinafter, a display 
method of the detection subject area in the auto focus- 
ing, appropriate for a novice user will be explained with 
reference to Fig. 7 and Fig. 8. 

[0076] ' Figs. 7 and 8 shows a simplified area mark C1 
obtained by synthesizing the display marks in Figs. 5 
and 6. Fig. 7 shows a display example before execution 
of the auto focusing function, and Fig. 8 shows a display 
example after execution of the auto focusing function. 
In Fig. 7 and 8, the monitoring image is not shown. 
[0077] In Fig. 7, the area mark C1 obtained by syn- 
thesizing all the detection subject areas of the auto fo- 
cusing methods used in the hybrid auto focusing func- 
tion. The area mark C1 is in a cross-like shape with ver- 
tical and lateral straight lines combined in a cross-like 



state with the intersection part of the lines omitted. It is 
shown in "white color" as the standby display. Then, as 
shown in Fig. 8, while the focusing state is not realized 
after starting the auto focusing controlling operation, the 

5 areamark C1 is displayed in "red color" as the non-fo- 
cused (that is, photography inadvisable) state. When 
the focusing state is realized after executing the auto 
focusing control, the area mark C1 is displayed in "green 
color". The focusing judgment result in this instance is 

10 either focused or non-focused. 

[0078] The area mark for displaying the detection sub- 
ject area is not limited to the embodiments shown in 
Figs. 7 and 8, but it can be in any form as long as the 
user can see where the object image to be focused 

is should be disposed on the display screen of the LCD 7. 
[0079] As mentioned above, according to the hybrid 
auto focusing method, not only the method of detecting 
the focusing positions using independently the auto fo- 
cusing method by the phase difference sensor and the 

20 contrast detection type auto focusing method, but also 
the focusing method as a combination of the both meth- 
ods by measuring the distance on the whole by the auto 
focusing method by the phase difference sensor so as 
to specify the substantial focusing position, and sam- 

25 pling the vicinity thereof by the contrast detection type 
auto focusing method in detail. 

[0080] Fig. 9 is a flow chart which explains the focus- 
ing operation of the hybrid focusing function. The figure 
shows the flow of making the focus judgment as the hy- 

30 brid auto focusing function in the instance at least the 
judgment result of at least one of the auto focusing meth- 
ods is provided as focused in the focusing method of 
measuring the distance on the whole by the auto focus- 
ing, method by the phase difference sensor so as to 

35 specify the substantial focusing position, and sampling 
the vicinity thereof by the contrast detection type auto 
focusing method in detail. 

[0081] In Fig. 9, in the instance the release button is 
half-pressed, first, the CPU 1 controls the exposure 

40 (step S11 ), then, focusing by the phase difference sen- 
sor type auto focusing method is executed (step S12). 
The focusing result by the phase difference sensor type 
auto focusing method is judged (step S13). 
[0082] As the judgment result, in the instance the 

45 phase differencesensortype auto focusing methodsuc- 
ceeds in focusing, the CPU 1 executes focusing by the 
contrast detection methods with the distance in the vi- 
cinity thereof focused (step S14). Thereafter, the CPU 
1 judges the focusing result by the contrast detection 

50 type focusing method (step S 15). 

[0083] As the judgment result, in the instance the con- 
trast detection type focusing method succeeds in focus- 
ing, the focusing judgment result as the hybrid auto fo- 
cusing function is made as success (step S16). As 

55 shown in Fig. 8, the area mark C1 color is changed to 
green color (step S17) so as to finish the process. 
[0084] Moreover, at the step S15, in the instance the 
contrast detection type auto focusing method focusing 
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is judged to be failed, the photography lens system is 
moved to the focusing position of the phase difference 
sensor type auto focusing method (step S18) so as to 
move to the stepS16. 

[0085] In contrast, in the instance the phase differ- 
ence sensor type auto focusing method is failed at the 
step S13, the CPU 1 the contrast detection is executed 
by the contrast detection type auto focusing method per 
a predetermined step from the extremely close point to 
the infinite point for focusing (step S19). The CPU 11 
judges the focusing result by the contrast detection type 
auto focusing method (step S20). In the instance focus- 
ing by the contrast detection type auto focusing method 
is judged to be successful, it moves to the step S16. 
[0086] Moreover, in the above-mentioned step S20, 
in the instance focusing by the contrast detection type 
auto focusing method is failed, the CPU 1 judges that 
the focusing judgment result as the hybrid auto focusing 
function is failed (step S21) and changes the area mark 
C1 color to the red color as shown in Fig. 8 (step S22) 
so as to finish the process. 

[0087] In the instance the focusing operation and the 
exposing control are executed as well as the strobo- 
scope automatic light emission function is selected 
when the user half-presses the release button, judg- 
ment may be made for whether or not the stroboscope 
light emission is executed. At the time, in the instance 
. the distance measurement result is a distance outside 
the stroboscope reaching range although the strobo- 
scope light emission is to be executed, the area mark 
C1 display color may be changed to another color such 
as yellow color. Thereby, photography unintended by 
the user in the stroboscope light emission photography 
can effectively prevented. 

[0088] Moreover, including the focusing judgment re- 
sult of the auto focusing system, as to the color display, 
colors other than the above-mentioned may be used as 
well as the flicker display or a different area mark display 
shape may be adopted instead of changing the display 
colors. Furthermore, as shown in Fig. 1 0, another graph- 
ic showing in appropriateness of the stroboscope (elec- 
tronic flash gun), or the like can be displayed. 
[0089] Moreover, in the instance photography is exe- 
cuted with an inappropriate photography condition in- 
cluding the focusing judgment result, ft is also possible 
that whether or not the Image is to be taken into the ex- 
ternal memory device 1 2 is selected by the user opera- 
tion of the operation section 1 3 at the time the recording 
image configuration screen is displayed on the LCD 7 
after the photography. Thereby, in the instance an inap- 
propriate photography condition including the focusing 
judgment result by the hybrid auto focusing function ex- 
ists, the user can avoid the taking in operation at the 
time of taking into the memory device after the photog- 
raphy, the tabor of erasing an image photographed in a 
manner not intended by the user afterwards can be omit- 
ted. 

[0090] As heretofore explained, according to the sec- 



ond embodiment, the IPP 5 displays the detection sub- 
ject area to be focused by the hybrid auto focusing func- 
tion, superimposed on the monitoring image of the LCD 
7. The CPU 1 judges the focusing result at the time of 

5 operating the hybrid auto focusing function. The IPP 5 
changes the display form of the detection subject area 
displayed on the LCD 7 according to the judgment re- 
sult. Thereby, the user can easily recognize where to 
place the object to be focused in the monitoring screen 

10 in the image pick-up device comprising the hybrid auto 
focusing function. 

[0091 ] Moreover, since the display/non-display of the 
detection subject area can be selected by the user op- 
eration of the operation section, intervention of the de- 

*5 tection subject area display mark at the time of deter- 
mining the composition by the user while observing the 
monitoring screen can be prevented. 
[0092] Furthermore, as the judgment criterion for the 
focusing result of the hybrid auto focusing function, 

20 since any one of the (a) method of judging that it is fo- 
cused finally in the instance both of the phase difference 
type auto focusing method and the contrast detection 
type auto focusing methods succeeded in focusing, the 
(b) method of judging that it is focused finally in the in- 

25 stance at least one of the phase difference type auto 
focusing method and the contrast detection type auto 
focusing method succeeded in focusing, the (c) method 
of judging that it is focused finally in the instance either 
of the phase difference type auto focusing method and 

30 the contrast detection type auto focusing method is se- 
lected automatically based on the brightness in the de- 
tection subject area or the vicinity thereof, and the se- 
lected auto focusing method succeeded in focusing, and 
the (d) method of judging that it is focused finally in the 

35 instance the auto focusing method preliminarily select- 
ed by the operation of the operation section 13 by the 
user from the phase difference type auto focusing meth- 
od and the contrast detection type auto focusing method 
succeeded in focusing is used by the CPU 1 . the focus- 

40 ing result can be judged easily in any auto focusing 
method in the hybrid auto focusing function by corre- 
sponding to various judgment forms. 
[0093] Moreover, since the focusing judgment criteri- 
on can be selected by the user operation of the opera- 

45 tion section from the above-mentioned (a) to (d), the us- 
er can select the focusing judgment criterion of the hy- 
brid auto focusing function. 

[0094] Furthermore, since the detection subject areas 
are identified and displayed for each of a plurality of the 

5Q auto focusing methods used in the hybrid auto focusing 
function (see Fig. 5 and Fig. 6), the detection subject 
are of each auto focusing method in the hybrid auto fo- 
cusing function and the focusing judgment result can be 
recognized individually by the user. 

55 [0095] Moreover, since the detection subject area ob- 
tained by synthesizing all the detection subject areas of 
a plurality of the auto focusing methods used in the hy- 
brid auto focusing function are displayed (see Fig. 7 and 



9 



UDOCir): <PP 1250002A1 I > 



17 



EP 1 250 002 A1 



18 



Fig. 8), the auto focusing detection subject area can be 
displayed preferably for a novice user. 
[0096] Furthermore, since the IPP 5 changes the dis- 
play color or the display shape of the detection subject 
area displayed on the LCD 7 according to the focusing 
judgment result so as to have different display forms for 
the detection subject area, the display form for the de- 
tection subject area can be provided differently by an 
easy method. 

[0097] Also in the instance of not using an electron 
finder at the time of using an optical finder, or the like, 
or in the instance of not displaying the detection subject 
area, an audio outputting unit which outputs the judg- 
ment results as a voice can be provided to advise the 
judgment results including the focusing, the exposure, 
the white balance, and the stroboscope appropriate ex- 
posure distance range. 

[0098] The present invention is not limited to the 
above-mentioned embodiments, and it can be executed 
with optional modification within a scope not to change 
the gist of the invention. 

[0099] As heretofore explained, according to one as- 
pect of the present invention, in an image pick-up device 
comprising a monitor display section or a finder display 
section, since the photography advisability information 
obtaining unit which obtains photography advisability in- 
formation showing whether or not the photography is ad- 
visable, and the display controlling unit which displays 
a target mark used as the criterion for the photography 
on a monitor display section or a finder display section 
and changes the target mark display form according to 
the content of the photography advisability information, 
are provided, the photography advisability information 
showing the advisability of the photography can be dis- 
played easily in an easily understandable form without 
preventing the photography. 

[0100] Moreover, according to another aspect of the 
present invention, in an image pick-up device compris- 
ing a display section which displays an image, having a 
hybrid auto focusing function usable with a combination 
of a plurality of auto focusing methods, to be used as an 
electron finder by displaying a monitoring image in the 
photography field of view in the above-mentioned dis- 
play section, since the area displaying unit which dis- 
plays the detection subject area to be focused by the 
hybrid auto focusing function on the display section, su- 
perimposed on the monitoring image, the judging unit 
which judges the focusing result at the time of operating 
the hybrid auto focusing function, and the display chang- 
ing unit which changes the display form for the detection 
subject area to be displayed on the display section ac- 
cording to the judgment result of the judging unit, are 
provided, the detection subject area in the hybrid auto 
focusing function with a combination of a plurality of auto 
focusing methods and the focusing judgment result can 
be displayed easily in an easily understandable form 
without preventing the photography so that the object 
part desired by the user can easily be focused, and fur- 



thermore, the focusing judgment result can be recog- 
nized accurately by the user. 

[0101] The present document incorporates by refer- 
ence the entire contents of Japanese priority docu- 

5 ments, 2001 -121 81 6 filed in Japan on April 19,2001 and 
2001-114321 filed in Japan on April 12, 2001 . 
[0102J Although the invention has been described 
with respect to a specific embodiment for a complete 
and clear disclosure, the appended claims are not to be 

10 thus limited but are to be construed as embodying all 
modifications and alternative constructions that may oc- 
cur to one skilled in the art which fairly fall within the 
basic teaching herein set forth. 

15 

Claims 

1. An image pick-up device having a monitor display 
section or a finder display section, the image pick- 

20 up device comprising: 

a photography advisability information obtain- 
ing unit which obtains photography advisability 
information indicating whether or not an image 

25 can be picked-up; and 

a display controlling unit which displays a target 
mark to be used as the criterion of the image 
picking-up on the monitor display section or the 
finder display section and which changes the 

30 display form of the target mark according to the 

content of the photography advisability infor- 
mation. 

2. The image pick-up device according to claim 1, 
35 wherein the photography advisability information is 

information on the focus/non-focus in the auto fo- 
cusing control. 

3. The image pick-up device according to claim 1, 
40 wherein the photography advisability information is 

stroboscope use advisability information based on 
distance measurement information. 

4. The image pick-up device according to claim 3, 
45 wherein the photography advisability information is 

information on whether or not it is in the stroboscope 
reach limit distance range. 

5. The image pick-up device according to claim 3, 
50 wherein the photography advisability information is 

information on whether or not it is in the stroboscope 
shortest distance range. 

6. The image pick-up device according to claim 1, 
55 wherein the photography advisability information is 

information on the focus/non-focus based on dis- 
tance measurement information at the time of man- 
ual focusing. 
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'7. The image pick-up device according to claim 1, 
wherein the display controlling unit changes the tar- 
get mark display form by changing the target mark 
display color according to the content of the photog- 
raphy advisability information. 

8. The image pick-up device according to claim 1, 
wherein the display controlling unit changes the tar- 
*get mark display form by changing the target mark 
flickering cycle according to the content of the pho- 
tography advisability information. 

9. The image pick-up device according to claim 1, 
wherein the target mark has a cross-like shape. 

10. The image pick-up device according to claim 9, 
wherein the display controlling unit displays a dis- 
tance measurement area based on lateral width and 
vertical width of the target mark. 

11. An image pick-up device having a display section 
which displays an image, and a hybrid auto focusing 
function usable with a combination of a plurality of 
auto focusing methods, to be used as an electron 
finder by displaying a monitoring image in the pho- 
tography field of view on the display section, the im- 
age pick-up device comprising: 

an area displaying unit which displays a detec- 
tion subject area of the focus by the hybrid auto 
focusing function on the display section, super- 
imposed on the monitoring image; 
a judging unit which judges the focusing result 
at the time of operating the hybrid auto focusing 
function; and 

a display changing unit which changes the dis- 
play form of the detection subject area dis- 
played on the display section according to the 
judgment result of the judging unit, are provid- 
ed. 
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focusing operations are executed in the plural- 
ity of the auto focusing methods and at least 
one of the methods succeeded the focusing, 

(c) judging that focusing of the hybrid auto fo- 
cusing function is successful in the instance 
any of the plurality of the auto focusing methods 
is selected preliminarily based on the bright- 
ness in the detection subject area or the vicinity 
thereof, and the selected auto focusing method 
succeeded in focusing, and 

(d) judging that focusing of the hybrid auto fo- 
cusing function is successful in the instance 
any of the auto focusing methods is selected 
preliminarily by the user, and the selected auto 
focusing method succeeded in focusing. 

14. The image pick-up device according to claim 13, 
further comprising a selecting unit with which a user 
selects one of the methods (a) to (d). 

15. The image pick-up device according to claim 11, 
wherein the area displaying unit identifies and dis- 
plays each of the plurality of the auto focusing meth- 
ods used in the hybrid auto focusing function. 

16. The image pick-up device according to claim 11, 
wherein the area displaying unit displays a detec- 
tion subject area obtained by synthesizing all the 
detection subject areas of the plurality of the auto 
focusing methods used in the hybrid auto focusing 
function. 

17. The image pick-up device according to claim 11, 
wherein the display changing unit changes the dis- 
play form of the detection subject area by changing 
the display color or the display shape of the detec- 
tion subject area displayed on the display section 
according to the judgment result of the judging unit. 



1 2. The image pick-up device according to claim 1 1 , fur- 
ther comprising a selecting unit with which a user 
selects display-non-display of the detection subject 
area by the area displaying unit. 45 

13. The image pick-up device according to claim 11, 
wherein the judging unit uses any one of methods 
(a) to (d) as the judgment criterion of a focusing re- 
sult: so 



(a) judging that focusing of the hybrid auto fo- 
cusing function is successful in the instance the 
focusing operations are executed in the plural- 
ity of the auto focusing methods and all of the 55 
auto focusing methods succeeded in focusing, 

(b) judging that focusing of the hybrid auto fo- 
cusing function is successful in the instance the 
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